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Abstract 

Boltzmann-Gibbs statistical mechanics is based on the entropy Sbg = 
~~ & Yli=i Pi In Pi- It enables a successful thermal approach of ubiquitous sys- 
tems, such as those involving short-range interactions, markovian processes, 
and, generally speaking, those systems whose dynamical occupancy of phase 
space tends to be ergodic. For systems whose microscopic dynamics is more 
complex, it is natural to expect that the dynamical occupancy of phase space 
will have a less trivial structure, for example a (multi)fractal or hierarchical 
geometry. The question naturally arises whether it is possible to study such 
systems with concepts and methods similar to those of standard statistical 
mechanics. The answer appears to be yes for ubiquitous systems, but the 

concept of entropy needs to be adequately generalized. Some classes of such 

i-Y w _ P " 

systems can be satisfactorily approached with the entropy S q = k — glj 1 1 
(with q G H, and S\ = Sbg)- This theory is sometimes referred in the 
literature as nonextensive statistical mechanics. We provide here a brief in- 
troduction to the formalism, its dynamical foundations, and some illustrative 
applications. In addition to these, we illustrate with a few examples the con- 
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cept of stability (or experimental robustness) introduced by B. Lesche in 1982 
and recently revisited by S. Abe. 

I. INTRODUCTION 

Thermodynamics is based on two pillars: energy and entropy. The first one concerns 
(dynamical or mechanical) possibilities; the second one concerns the probabilities of those 
possibilities. The first one is more basic, and clearly depends on the physical system (clas- 
sical, quantum, relativistic, or any other); the second one is more subtle, and reflects the 
information upon the physical system. It is obvious that the first one, the energy, is directly 
associated with the specific system, characterized for example by its Hamiltonian (which 
includes possible inertial terms, possible interactions, possible presence of external fields). 
It is much less obvious that the same seems to happen with the second one, the entropy. 
It was long believed that the microscopic expression of the physical entropy had to be uni- 
versal, i.e., system-independent (excepting for the trivial fact that it has to depend on W). 
More precisely, it had to be, for all systems, the well known one, namely 

w 

S B G({Pi}) = -kJ^Pilnpi , (1) 
i=i 

with its celebrated expression for equal probabilities 

S BG ( Pi = l/W,Vi)=k\nW , (2) 

W being the total number of possibilities of the system under overall restrictions such as 
its total energy, total number of particles, and similar ones. However, this widespread belief 
of universality appears to have no rigorous basis. Indeed, it appears nowadays that the 
concept of physical information, and its microscopic expression in terms of probabilities, 
must be adapted to the system about which it is providing information, pretty much like 
impedances of interconnected circuits have to be similar in order to have an efficient and 
useful communication. Expressions (1) and (2) are so commonly used because most of the 
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systems whose thermal properties are studied belong to the type involving (strong) chaos 
in its microscopic dynamics, i.e., positive Lyapunov exponents. There is no fundamental 
reason for which the same expression should necessarily be used for systems involving say a 
vanishing Lyapunov spectrum, i.e., for systems exhibiting weak chaos. Indeed, such systems, 
if isolated, might have serious difficulties in satisfying the ergodic hypothesis during the 
observational time of physical measures. 

It is clear that the above statements about the nonuniversality of the microscopic expres- 
sion for the entropy are by no means self-evident. It is through a variety of recent verifications 
that we have come to such possibility. The present paper focuses on some of this growing 
evidence. If, however, Sbg is n °t universal, how to generalize it? No logical-deductive path 
ever existed for proposing a new physical theory, or for generalizing a pre-existing one. In 
fact, such proposal frequently — perhaps always — occurs on a metaphorical basis. The 
analysis of the structure of the BG theory provides us a metaphor for formulating a statis- 
tical mechanics which might be more powerful than the one we already have thanks to the 
genius of Boltzmann, Gibbs, and others. It is perhaps worthy at this stage to explicitly insist 
that we are talking of a generalization of the BG theory, by no means of an alternative to it. 
Without further delays, let us construct [1] a statistical mechanics based on the following 
expression for the entropy: 

1 _ v 1 ^ rfl 

S q {{Pr}) = k (q eH;S 1 = S BG ) , (3) 

with the following expression for equal probabilities 

W l ~ q - 1 

S q (pi = l/W,Vi) = k — - — — = k\n q W QmW = InW). (4) 

If A and B are two independent systems (i.e., pfj +B = pfpf), we verify that 
S q (A + B) S q (A) S q (B) S q (A)S q (B) 

k ~~ ~~ k ' k ^ 7 7—, 10 J 

hence subextensivity (superextensivity) occurs if q > 1 (q < 1). Furthermore, it can be 
shown that the nonnegative entropy S q is concave (convex) for q > (q < 0). 
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Under appropriate canonical constraint (in addition to the trivial one Y^LiPi — 1), the 
entropy (3) is optimized (maximized for q > 0, and minimized for q < 0) by the following 
distribution [1-3] 

e -P'Ei 

Pi = " p Ej . ( 6 ) 

where is the energy of the i — th microscopic state, f3' plays the role of an inverse 
temperature, and the g-exponential function is defined as the inverse of the ln q x function, 
i.e., e x = [1 + (1 — q)x}~ (ef = e x ). A set of mini- reviews on the subject can be found in 
[4]. The main properties of the theory, as well as its connection with thermodynamics, are 
there explained with great detail. 

II. DYNAMICAL FOUNDATIONS 

It is clear that for the above theory to be complete we need to indicate how the entropic 
index q can in principle be calculated a priori for a given system. Consistently with the 
ideas of Einstein [5], Krylov [6], Cohen [7], Baranger [8], and many others, the value of q 
must be hidden in the microscopic (or mesoscopic) dynamics of the system. A large amount 
of examples enable to illustrate that it is indeed so. We shall restrict here to just one of 
them, a very simple one, namely the family of logistic maps. Many others can be found in 
[4]- 

Consider the one-dimensional dissipative map 

x t+1 = 1 - a \x t \ z (0 < a < 2; z > 1) , (7) 

with — 1 < x t < 1 and t = 0,1,2,... A value a c (z) exists for this map (e.g., a c (2) = 
1.401155...) such that for a > a c (z) (a < a c (z)) the Lyapunov exponent Ai tends to be 
positive (negative). At the edge of chaos, a = a c (z), the Lyapunov exponent precisely 
vanishes. For all values of a such that the Lyapunov exponent exponent is different from zero, 
we have that the sensitivity to the initial conditions £ = \im Ax ^^ [Ax(t) / 'Ax(O)] = e Al *. 
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But at a c (z) we have £ = e^™* [9-11], with \ sen (z) > 0, and q sen (z) varying from — oo to 
almost unity, when z varies from unity to infinity (sen stands for sensitivity). For example 

q sen {2) = 0.2445... (8) 

This same value can be found through a connection with multifractal geometry. If we denote 
by f(a) the multifractal function, and a m i n and a max the two values of a at which f(a) 
vanishes, we can argue [12] that 

1 _ _J_ _ 1 _ (z - 1) \na F (z) 
l-q sen (z) ot min (z) a max (z) ln2 

where cxf(z) is the ^-generalization of the Feigenbaum universal constant. 

The same value q sen ( z ) can be found through a third method, namely by studying the 
entropy production per unit time. We partition the [—1, 1] x interval in W little windows. 
We choose one of them and place (randomly or regularly) M initial conditions inside it. 
We then follow those points as a function in time, and get the set of occupation numbers 
{Mi(t)} (TZi M i(t) = M). We then define a probability set through pi(t) = Mi(t)/M (Vi), 
and calculate S q (t)/k using Eq. (3), and fixing some value for q. We then average over 
all initial windows (or a large number of them randomly chosen, which turns out to be 
numerically equivalent), and obtain (S q )(t)/k. We finally define the entropy production per 
unit time as follows 

K q = lim lim hm ^MUl . (10) 

This concept essentially reproduces the so called Kolmogorov-Sinai entropy although gener- 
alized for arbitrary value of q. The equivalent of the usual Kolmogorov-Sinai entropy (which 
is fact not an entropy but an entropy production) is recovered for q — 1. We can verify 
for the z-logistic map that K q vanishes (diverges) for q > q sen (q < q sen ), and that K qsen is 
finite, and coincident with \ qsen (g-generalization of Pesin theorem [9-11,13]). 

It is finally possible to recover q sen through a forth method, namely through the Lebesgue 
measure shrinking: see [14,15] for details. 



Through this example of the logistic maps we have illustrated many relevant concepts 
concerning the index q and the dynamical foundations of nonextensive statistical mechanics. 
One or other of these concepts, as well as a few somewhat different, have been shown for 
quantum chaos [16], cercle maps [17], Henon map [18], standard maps [19,20], lattice Lotka- 
Volterra model [21], lattice Boltzmann model for the Navier-Stokes equations [22], growth 
of free-scale networks [23] (the distribution turns out to be a g-exponential), long-range- 
interacting many-body Hamiltonian classical ferromagnets [24-33], Lennard- Jones clusters 
[34] (the distributions are in fact g-exponentials) , transport in quantum optical lattice [35], 
correlated [36], Levy- like [37] and other anomalous diffusions [38,39], multiplicative noise 
[40] and dichotomic colored noise [41] Langevin-like diffusions, among others. 

III. SOME APPLICATIONS 

The above theory has been applied in the literature to a large variety of systems, in 
addition to the ones we have just mentioned. Some of those attempts use various degrees of 
phenomenology, the q index being obtained from fitting of experimental or computational 
available data. This is of course not an intrinsic necessity, but rather the consequence of 
the ignorance of the exact microscopic or mesoscopic dynamics of the natural or artificial 
system that is focused. 

Examples that have been analyzed include re-association in folded proteins [42], fluxes 
of cosmic rays [43], turbulence [44-46], finance and economics [47], electron-positron anni- 
hilation [48], motion of Hydra cells [49], epilepsy [50], linguistics [51], nuclear physics [52], 
astrophysics [53], distributions in music [54], urban agglomerations [55], internet phenomena 
[56] , among others. 

Finally, a special mention deserve the numerous applications that have been done [57] 
in algorithms for global optimization (e.g., the generalized simulated annealing) and related 
computational methods. 
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IV. STABILITY OR EXPERIMENTAL ROBUSTNESS 



Lesche introduced [58] two decades ago a quite interesting property that Sbg satisfies. 
He named this property stability. However, in a recent private conversation, one of us (CT) 
proposed to him the use of the denomination experimental robustness instead. He agreed 
that such denomination reflected better the physical content of the mathematical property 
he had himself introduced. In addition to this, the expression "stability" might be confused 
with "thermodynamical stability", which has to do with the concavity of the entropy, a 
completely different and independent property. We shall therefore use either stability or 
experimental robustness indistinctively. This property was further discussed recently by Abe 
[59,60]. In the present Section, we shall illustrate the property in a few typical cases, and will 
even start analyzing the possibility of enlarging it to metrics other than the one originally 
used in [58]. The property consists in a specific kind of continuity. If two probability 
distributions are close to each other (which corresponds to slightly different realizations of 
a given experiment), this is expected to correspond to a relatively small discrepancy in any 
physical functional of the probability distribution, in particular in the entropy. 

The mathematical expression of this basic property follows. We first introduce a distance 
d a = \ \p — p'\\a between two probability sets {p^ and {p'j} associated with the same system: 

w , , 

d a =[Y,\Pi-pT] («>!)■ (11) 

i=l 

Lesche used a — 1; we shall enlarge here his definition (e.g., a = 2 corresponds to the 
Pithagorean distance). The interval < a < 1 also defines a quantity which could be 
temptatively thought as measuring distances. However it does not constitute a metric, 
because it violates the triangular inequality. We shall therefore not consider that possibility 
at the present stage. 

We define now the relative discrepancy R of the entropy as follows: 

R _ siM) - sap',}) ^ 

Srnax 
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where S max is the maximal value that the entropy under consideration can attain. For 
instance, the maximal value for Sbg is k In W. 

We will say that S is a-stable (or experimentally a-robust) if and only if, for any given 
e > 0, a 5 e > exists such that, independently from W, 

d a <5 e =>• \R\ < e . (13) 

This implies, in particular, that lim^^o linny->oo R(d a , W) = (linny->-oo lim^^o R(d>a, W) 
always vanishes). 

Let us apply definition (13) to the present nonextensive entropy S q , to the Renyi entropy 
Sq = hiX^iPi/((Z — 1) = ln[l + (l — q)S q /k]/(l — q), to the normalized nonextensive entropy 
[61] = S q /YZiP q i = S q /[l + (l-q)S q /k], and to the escort entropy Sjf defined as follows 
[3]: 

sf({ Pi }) = k — ~~p ^ 

This entropy emerges from S q ({pi}) where we do the escort transformation, namely pi = 
Pi^ q I Ylf=i Pj^' an d then, for convenience, rename Pj — > pi. 

Lesche showed [58] that Sbg is 1-stable and that is not for any q ^ 1. Abe showed 
[59,60] that is 1-stable for all q > 0, whereas is not for any value of q ^ 1. We 
shall illustrate here these facts, including the case a > 1. In addition to this, we shall 
also illustrate that neither is 1-stable. To do so we shall consider, following Abe, two 
typical cases, from now on referred to as quasi- certainty (QC) and as quasi- equal-probabilities 
(QEP). 

The quasi-certainty case refers to the following: 

Pl = l;p t = (Vi + 1) , (15) 

and 

= 1 " ^ = Iw^T < Vt * l) • < 16) 



hence 



1 + 



1 l/a 



(W- l)a-l. 



(17) 



consequently 



1/q 



(18) 



(w-i)"- 1 . 

We verify that di = <5 independs from W, whereas, for a > 1, d a depends from W, and 
limw^ooda = 5/2 (Va > 1). 

The quasi-equal-probabilities case refer to the following: 

1 



Pi = 0; ^ 



W - 1 



(V< ^ 1) , 



(19) 



and 



Pi 



1 



hence 



d a 



1 + 



5 



l/a 



(20) 



(21) 



consequently 



2d a 



1 + 



l/a 



(22) 

Once again we verify that d 1 — 5 independs from W, whereas, for a > 1, d a depends from 
W, and Mmw^ooda = 5/2 (Va > 1). Notice that, for this QEP case, the results in Eqs. (21) 
and (22) turn out to exactly coincide with those corresponding to the QC case, namely Eqs. 
(17) and (18). 

We may now calculate, as functions of (5, W, a, q) and for both quasi-certainty and quasi- 
equal-probabilities cases, the quantities R q , R^, and R^, respectively associated with 
the entropic functionals S q , S q , and S q . We obtain the following results: 

(1 - 5/2Y + (5/2f{W - lf- q - 1 



R„ 



W x ~i - 1 



(QC) 



(23) 
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^ ^^-^-(w-a-OT-i)^ {QEP) (24) 



R * ~ (l-q)\nW (gC) (25) 



r r (1 ~ q) In iW-l)- In [(j/2)« + (1 - j/2)«fly - 

^ = (l-g)lnW (gEP) (26) 



R « = 1 _ Wq -i ( QC > W 



R q = 1 _ Wq -i ^ EP > ^> 



R q = wl _ q _ i (QC) (29) 

R i = W i- q _ i KQ^n ( 30 ) 

All these ratios can be expressed as explicit functions of (d Q , W, a, g) if we use Eqs. (18, 22). 

We present typical examples in Fig. 1 for Sbg, and in Figs. 2 and 3 for its four 
generalizations. We notice in Figs. 2 and 3 that only R q satisfies (13) for all the examples; 
R* violates (13) for QC with q < 1, and for QEP with q > 1; R" violates (13) for QC with 
q < 1, and for QEP with q > 1; Rf violates (13) for QEP with g < 1, and for QC with 
q > 1. 

At this point, let us make a remark about the a > 1 metrics. This class of distance 
satisfies, as already mentioned, the triangular inequality. This is why we have considered it 
until now. However, it presents an inconvenient peculiarity. Let us illustrate this through 
the following example (assuming W even): 

W 2 W W 

Pi = (t = 1, 2, —)■ Pi = — (i = — + 1, — + 2, W) , (31) 

and 
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5 2 W , 5\ 2 WW 

= y«= 1,2, f ); = (1 - |) F (i = f + 1, £ + 2, W) , (32) 



hence 

rf a = <W (1 - q)/q . (33) 

As for the QC and QEP cases considered above, di = 5. But, for a > 1 and W — > oo, c? Q — > 0. 
Consequently, although {p^} 7^ {j^}, their distance d Q vanishes, a quite inconvenient feature. 
We thus verify that di is very special indeed, since it does not depend on W. 

Finally, in order that it becomes clear that stability is a property independent from 
concavity, we represent, in Fig. 4, typical cases (namely those associated with the W = 2 
system) of all four generalizations of S B g considered here. We notice that only S q satisfies 
concavity for all values of q > 0; and are concave for < q < 1, but not for q > 1; 

is concave for q > 1, but not for < q < 1. 

V. CONCLUSION 

We have provided a brief introduction to nonextensive statistical mechanics and to its 
connections to thermodynamics, as well as a few explanations about its dynamical founda- 
tions. Various applications have been mentioned, and the reader is referred to the appro- 
priate references for further details. Many interesting open questions remain to be further 
investigated. Among them, let us mention the subtle, and yet not completely clarified, 
connection between the present ideas and long-range-interacting Hamiltonians. 

In Section IV we have addressed the property of stability (or experimental robustness) 
introduced by Lesche in 1982. We have illustrated, for typical cases and metrics, the generic 
validity of this property for the nonextensive entropy S q , as well as its nonvalidity for the 
(extensive) Renyi entropy S q , for the normalized nonextensive entropy S q , and for the 
escort nonextensive entropy S q . In addition to this, we have also illustrated the validity or 
nonvalidity of the concavity property for the same entropic forms. 
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Last but not least, the history of sciences teaches us that all attempts of innovation in 
the scientific theories have been the subject of objections or critical comments. The present 
attempt is no exception. We may mention the critique in [62], counterbalanced in [63-65], 
the critique in [66], counterbalanced in [30,31], and the critique in [67], counterbalanced in 
[38,47]. 
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FIG. 2. Typical examples (QEP and QC, q < 1 and q > 1) for the stability (or lack of stability) 
of the S q and entropies. The dashed (continuous) curves correspond to the a = 1 (a = 2) metric. 
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